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ABSTRACT 



A comprehensive review of the literature on 
organizational training and development is undertaken in this report. 
Developments in learning, motivation, and attitude theory are 
discussed, with particular attention being paid to the theory and 
techniques of behavior modification and to General Systems Theory. 
Computer- assisted instruction and methods for training disadvantaged 
applicants are discussed. The literature of research and evaluation 
methodology is noted, along with its lack of innovation. Finally, 
empirical studies of training and development outcomes are reviewed; 
most of these studies are concentrated in three areas: laboratory 
education, programed instruction, and training the disadvantaged. 
Research in these three areas has borne fruit, but they are bright 
spots in an otherwise dismal picture. For example, although 
management development is a huge enterprise, we know next to nothing 
about its behavioral effects. The report concludes with a discussion 
of reasons why the state of the art is what it is and with 
recommendations for future research and practice. (Author/HF) 
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and training the disadvantaged. Research in these three areas has born fruit, 
especially with regard to the disadvantaged. However, they are bright spots in 
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Personnel Training and Development 
John P, Campbell 
University of Minnesota 

This review was frustrating for at least two r-easons. First, as the term 
is commonly used, personnel training and development can include such diverse 
elements as computer assisted instruction, encounter groups for executives and 
their wives, and training in basic work habits for so called hard core 
unemployables. It is an incredibly wide spectrum and certain topics are given 
scant attention. At the one extreme are very molecular studies of such 
things as acquisition and transfer problems in pursuit rotor training and 
concept learning. These border on basic research in learning, more properly 
belong in such a chapter, and will not be reviewed here. At the other extreme 
are the existentially derived basic encounter experiences. We will discuss 
neither the psychology not the organizational utility of shouting nasty things 
about one’s spouse in front of a group or having a sensitivity session sans 
clothing. 

Second, this is the first review of its kind. Training and development 
previously have been discussed as a subsection of "the psychology of men at 
work" [Hinrichs (104)] or "personnel management" [Porter (158)]. Thus, a 
question arises as to whether the review should cover the past two years, five 
years, or hark back to antiquity itself (1940 or thereabouts). As a result, 
the period of the review varies haphazardly with the particular subtopic. The 
overall objective was to go back far enough to uncover sufficient substance 
to describe the state of the art and document trends. In most cases this meant 
going back three to five years. Beyond that, secondary sources were employed. 
Also, since there were no previous chapters to serve as guides, the search for 
the psychology in the field was especially difficult. 



Another recurring phenomenon is the cyclical article. That is, there 
are several prototype papers that appear in the literature at regular 
intervals. For example there is the article admonishing people to evaluate 
their training efforts. There is another which argues that training should 
be well planned and systematic. Yet another reminds us that training and 
development efforts must have the support of top management or they will 
fail. There are 5-10 of these basic types, which say the same things over 
and over again in almost the same language. 

The plan of the current chapter is to discuss first some theoretical 
and conceptual issues that bear on the training and development problem. 
Second, recent developments in training techniques will be briefly noted. 
Third, fresh thoughts on the evaluation problem will be discussed. Finally, 
the empirical literature will be organized around specific topic areas. 

Models, Theories, and the Training Problem 

Historically, the primary theoretical foundation of training in organi- 
zations has been the so called ,! leaming principles”. They are still given 
a prominent place in the major textbooks [Bass & Vaughan (9), Blum & Naylor 
(20)] and they appear consistently in the literature [Halls tein (9l), McCord 

(139)]. 

Gagne’s (77) classic paper pointed out the secondary importance of 
the principles and suggested that other considerations were far more power- 
ful. He first made the reasonable assumption that total performance can 
be analyzed into a set of component tasks that are relatively distinct 
from each other. Further, proficiency on the task components is what med- 
iates total performance. Given these assumptions, the basic principles of 
training design consist of: 1) identifying the task components that make 

the desired performance, 2) incorporating these component tasks or 
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"mediators" in the training program, and 3) arranging the learning of the 
components in the optimal sequence for transfer to total performance* This 
sort of conceptualization implies that training practitioners and researchers 
should be concerned with such things as task analysis, terminal behaviors, 
component task achievements, the fidelity of training task components, and 
sequencing* It places the emphasis where it belongs, on the two questions 
of what is to be learned and what the substantive content of a training or 
development experience should be. Once these are answered, the additional 
question of what techniques to use, massed versus distributed practice, how 
to reinforce learner responses, etc., can be considered. Unfortunately, 
Gagne’s statement has stimulated very little activity among people inter- 
ested in organizational training and development. It stands in a state of 
suspended animation. What follows is a mere pittance of what there should 
be. 

Considering the question of what is to be learned, an earlier study 
by Glicktnan and Vallance (80) analyzed descriptions of specific mistakes 
made by naval technicians on the job and used this information to alter 
training content. By using the critical incident method the question of 
what is to be learned is answered in terms of actual job behavior and the 
specification of training content follows directly. This prototype study 
deserves a great deal of imitation, but there has been very little. In one 
exception, Folley (71) determined the desired behaviors of retail sales 
personnel by collecting critical incidents from customers. Over 2000 
incidents were collected, catagorized, and made the basis for training in 
customer service. In somewhat the same vein Buehler (28) developed a series 
of scaled critical job behavior incidents that defined the "desirability for 
retention" of clerical personnel. In effect, this was an analysis of total 
performance into its components. 

O 




5 



% | 



Backing away from a strict critical incident methodology, Harmon (94) 
discusses a more molar approach for specifying behaviors to be learned. He 
presents an analysis of performance objectives for Job Corps curriculum 
development. Fourteen objectives are grouped under three major headings: 
verbal performance, physical performance, and attitudinal performance. Each 
objective is explicated by descriptions of the desired behavior, the cond- 

i 

it ions under which the behavior should occur, and the success criteria by 
which the trainee f s behavior is to be judged. If a similar plan were followed 
by the majority of people interested in training and development problems, 
the knowledge gained would increase exponentially. 

An example of the difficulties generated by a retreat from behavioral 
specification of what is to be learned is illustrated by much of the content 
of management development. Hersey and Kellner (103) have reviewed many of 
the "theories” underlying such content. The theory of need achievement implies 
that training should create a high achievement need. Theory X versus Theory 
Y suggests managers should be taught the versatile use of Theory Y. The 
Herzberg two factor theory says that supervisors should learn to use intrinsic 
factors to motivate subordinates. Likert T s System Four suggests that a 
participative and consultative approach to management is best. Finally, the 
original Ohio State variables of consideration and initiating structure 
appear most forcefully in the management Grid approach. The prescription 
is that managers should be taught a style that maximizes both a concern for 
production and a concern for people. 

A controversy has recently arisen over whether the management Grid 
deserves a third dimension. Reddin (165, 166) argues that style theories 
aren T t useful because they imply an either /or approach using either the ideal 
or non-ideal style and they structure the world in terms of a few types 
instead of several gradations along a continuum. He also proposes that the 
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Grid must be made three dimensional and argues that each combination of 
employee and production centeredness can vary along an "ef fectiveness" 
dimension. That is, there may be situations in which even a 1, 9, 9, 1, or 
5, 5, may be effective. The implication is that a manager’s use of various 
styles must take account of situational and individual differences. Hersey 
and Blanchard (102) sound much the same theme and argue that the proper mix 
of production centeredness and employee consideration depends in a large 
degree on the developmental stage in the life cycle of the work group. For 
example, new work groups may require different management than old work 
groups. Common (51) also makes the Grid th^ee dimensional by postulating a 
commitment dimension which implies training should take account of individual 
differences in the probability of using various styles. 

The reviewer feels strongly that the above formulations of what is to 
be learned suffer because they have no direct link to behavior. The def- 
initions of the variables provide no clear specification of what the desired 
behaviors are or what the training content should be to insure acquisition 
of the component tasks. Determining training content thus is a rather large 
inferential step and depends a great deal upon the artistry of Blake, Likert, 
McClelland, and the like. 

One place we might expect to find a rigorous approach to specifying 
what is to be learned is in the area of programmed instruction and computer 

assisted instruction. Not so. Although there is certainly more emphasis on 

* 

describing terminal behaviors, no recognizable body of methodology for doing 
so has evolved. As yet, we lack even the rudiments of a theory of what is 
to bn learned. Frank and Smith (74) observe that task analysis and behav- 
ioral specification of training objectives seems to be a much more prevalent 
practice in Britain than in the United States. 

O 
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Attitude Theory 

Rather than think of management style as a set of overt behaviors one 
could also think of it in attitudinal terms, since it is so often measured 
via self report questionnaires. Thus, the things to be learned are a par- 
ticular set of attitudes, beliefs, or opinions. The attitudinal emphasis 
can be found in other training activities as well, such as supervisory 
attitudes toward minority groups. For such reasons, theories of attitudes and 
attitude change become relevant. Four excellent books on attitude measure- 
ment and attitude change have appeared in recent years. Shaw and Wright (184) 
succinctly compare all the major definitions of attitudes, discuss the 
theoretical and psychometric issues in attitude measurement, and system- 
atically review almost every published attitude scale in domestic psychology. 
Fishbein (67) has edited an excellent book of readings dealing with a broad 
spectrum of topics. Rokeach (172) reviews much of the literature on attitude 
change, distinguishes attitude from other concepts and presents his own comp- 
rehensive theory of attitudes. Kiesler, Collins, and Miller (115) spend 
their entire volume discussing five major types of attitude change theory. 
Anyone who deals with attitudes as training content should read these four 
books. All the major issues surrounding how to conceptualize attitudes, how 
to measure them, and hew to change them are discussed. They also document 
our lack of knowledge concerning the link between attitude change and behavior 
change. So far, none has been demonstrated. 

Motivation Theory 

Articles on training are fond of saying that the learner should be 
motivated but things never go much beyond that. The field could profit from 
a closer look at recent conceptual developments in work motivation. 
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The work of E. A. Locke and his colleagues (128) suggests a number of 
important points. For example, the effects of reinforcement on learning may 
be mediated by a process of goal setting [Locke (126), Locke, Bryan, & 
Kendall (128) ] . That is , unless the learner changes his goals in the 
training situation, reinforcements such as knowledge of results, money, or 
recognition may have no effect. Another suggestion is that adopting a 
specific goal, as opposed to a lf do your best” goal, results in greater effort 
and perhaps better response acquisition. Also, Locke (125) reanalyzed 
Fryer's data dealing with learning Morse Code and demonstrated that those 
who said they set high goals acquired correct responses faster than those 
who set low goals or no goals at all. 

Konwin (120.) showed much the same thing with female operatives in a 
stocking factory. The training program was geared to teaching the girls to 
pace themselves with goal setting. Production went up significantly and 
turnover went down. However, there was no control group and a placebo 
might have done as well. 

The reviewer has argued elsewhere (42) that some of the effects of 
goal setting may be due to its task definition component. That is, perform- 
ance is enhanced because in the process of setting a goal, the individual 
learns what he is supposed to do, whereas the task previously may have been 
unclear. Thus, as a training device, performance appraisal by means of 
mutual goal setting may be effective because it allows the subordinate to 
bring order to a previously ambiguous situation. This may be the explanation 
for the results of a study of T-group training by Kolb, Winter, and Berlew 
(119) which showed that when subjects (graduate students) set personal 
training goals there were more self and trainer perceived changes. Also, the 
stronger the commitment to the goal, the more the perceived change. In sum, 




the data are clear enough to warrant special consideration of how goal 
setting can be used in training and development programs. 

Also, Campbell et al. (42) postulate and cite evidence for the moti- 
vational influence of the individual’s degree of belief or expectancy that 
he can accomplish a particular goal or master a particular task. Thus an 
individual’s expectations of how well he will be able to handle the training 
content may have a lot to do with his motivation in the training situation. 
The expectancy/valence model is the strongest theme in current theories of 
work motivation and has considerable potential utility for training and 
development. Recent elaborations are given by Porter and Lawler (I 59 ), 

Lawler (12l), and Locke (127). 

Behavior Modification 

One of the most important books to be published during the period of 
this review is a definitive treatment of behavior modification principles and 
technique by Bandura (7). To date, this model of behavior change has been 
applied almost exclusively to neurotic, psychotic, or delinquent behaviors. 
However, the concepts and techniques are quite general and the reviewer 
strongly believes it could become a powerful training model in organizations. 
It is impossible to summarize the wealth of conceptual and empirical infor- 
mation in the Bandura book, but a few points are in order. A briefer but 
less definitive treatment can be found in Ullmann and Krasner (198). A 
popularized version is given by Mehrabian (140). 

Behavior modification is based in part on the Skinnerian and Pavlovian 
principles of conditioning but it goes considerably beyond and takes advan- 
tage of many recent findings in basic learning theory. Simply put, it seeks 
to change individual responses by changing the individual’s environment, 
primarily by altering reinforcement contingencies or stimulus pairings. It 



is the behavior that is at issue, not the underlying causes or internal 
mediators. In very general terms, the process would look something like 
this: 

The training objectives must be carefully specified in terms of 
specific desire^ behaviors. 

For purposes of alteration, the existing reinforcement contin- 
gencies or stimulus pairings currently operating must be care- 
fully described. 

New contingencies or pairings must be selected that will directly 
support the desired behavior. The new reinforcers must be powerful 
enough to alter behavior, and to maintain it once it has been 
changed. 

Change agents must be selected to administer the reinforcement. 

If the desired behavior is seldom emitted or is too complex to 
be reinforced contiguously then sub goals must be defined and the 
appropriate reinforcement contingencies applied to them (i.e. 
behavior must be "shaped"). 

After the behavior has been altered provisions must be made for 
making it self regulating. 

Bandura describes six methods of instituting new contingencies: 
modeling and vicarious processes, positive reinforcement, negative reinforce- 
ment, extinction, positive counterconditioning, and aversive countercondition- 
ing. Each is treated at length, examples are given, and the possible uses 
and limitations of each are discussed. For organizational purposes a combin- 
ation. of modeling and positive reinforcement would seem useful for many 
training situations. That is, the learner is shown a model who acts in the 
desired fashion and who is reinforced. The learner is then reinforced for 
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emitting behavior similar to that of the model. Thus many behaviors which 
previously were not in the individual’s repertoire can be generated and 
reinforced. The book deals with moral and ethical issues at length. In the 
societal setting, it is both possible and desirable that the change agent and 
learner agree on the reinforcement contingencies to be used and Bandura 
presents evidence to show that an individual’s awareness of the contingencies 
involved has an enhancing rather than distracting effect. A careful reading 
of the entire book suggests numerous organizational applications. Of course, 
the major stumbling block is in getting hold of the relevant reinforcers and 
being able to apply them directly and skillfully to the desired behavior. 

For example, rather than sending supervisors to human relations seminars to 
convince them of the desirability of acting certain ways toward subordinates, 
we should provide them with the correct behavior models and then reinforce 
the desired behavior with highly valued rewards. Because it would require 
such a radical reorientation of organizational life, substantial applications 
of behavior modification principles are not yet possible. However, the mass 
of data reviewed by Bandura suggests the awesome power of the technique and 
some tentative beginnings are desirable. Perhaps the employment problems of 
the so called "hard core" are a good place to begin. 

In a very interesting paper, Nord (152) argues that the operant condi- 
tioning model, in truth, has a great deal of structural similarity to the 
motivational theories of McGregor, Maslow, and Herzberg. It simply gets to 
the heart of the matter much more quickly. 

Individual Differences 

The relationship of individual differences to experimental treatments 
is an honored topic. This review is no exception. At the conceptual level 
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the most important recent publication is a book edited by Gagne (78). 

Cronbach (55) conceptualizes the problem of how instruction can be 
adapted to individual differences. He discusses: adaptation with fixed 

goals and fixed methods; adaptation by matching the instructional goals to 
the individual; adaptation by matching instructional methods to the individual 
and adaptation by selecting homogeneous groups. He then suggests that two 
individual variables of prime importance are general mental ability and the 
need achievement- fear of failure configuration. Evidence is cited to support 
his view. Glaser (79) makes a distinction between the traditional kinds of 
ID f s measures and what he calls initial states, and argues than the latter 
are potentially more interactive than the former. Thus, variables like prior 
achievement, training expectations, and initial skill level, are more potent 
than aptitude, interest, or personality measures. Lundberg (131) has outlined 
some potentially important initial state variables for management develop- 
ment. Jensen (111) specifically rejects the 40 or more ID’s measures devel- 
oped from factor analytic work and suggests a new taxonomy for explaining 
the error variance in training results. Perhaps his most important distinc- 
tion is between intrinsic variables, or individual differences in the learning 
processes themselves, and extrinsic variables which have an effect on learning 
outcomes but bear no resemblance to the learning process itself. 

Fleishman (69) s umm arizes the sizable amount of data he has produced on 
individual differences in psychomotor learning and makes a distinction between 

.abilities, as relatively enduring traits, and skills, as levels of profi- 
ciency of specific tasks. The objective is then to explain task performance 
skill via the underlying abilities. A taxonomy of psychomotor and motor 
abilities is presented. A number of studies using different methodologies 
are used to support the now famous argument that the ability requirements for 

O 
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task performance change considerably over the training period since as 
learning progresses the nature of the task changes. Also, as the number of 
trials increases, a larger and larger proportion of total variance is 
explained by factors specific to the task itself. Fleishman suggests that 
the ability variables which correlate highly with task performance at 
various training stages should dictate the instructional cues, or content, 
emphasized at each stage. Anderson (2) disagrees and argues that ability 
correlations are not as useful as a rigorous task analysis itself for spec- 
ifying training content. 

Hulin and Alvarez (107) take a more radical approach and argue that an 
individual’s ability level indeed may not be constant and might also change 
with training. Thus Fleishman’s results conceivably could be explained by 
changes in ability factors as well as task factors. They outline a research 
study to test the proposition. 

Historically, factor analyses of ability tests included in the same 
matrix with performance scores over trials have also been used to demonstrate 
the increasing importance of task specific factors during trainiqg. Hinrichs 
(104) conducted a study in which he varied the instructional set in a pursuit 
rotor task by emphasizing speed in one sample and accuracy in another. Each 
sample produced two task specific factors, one of which increased in impor- 
tance over trials and one of which decreased. However, the patterns of 
factor loadings were somewhat different across samples and conformed to 
expectations based on the instructional sets. The impact of these results is 
weakened somewhat by an earlier paper by Humphreys (108) which suggested that 
including trial x trial data in a correlation matrix may artif actually yield 
an increasing task specific factor and a decreasing task specific factor. 
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General Systems Theory 

The "systems approach” definitely qualifies as a buzz word. It is 
frequently mentioned in the titles of articles [e.g. Miller (142)] but 
typically, few hints are given as to what distinguishes the systems approach 
from other approaches to training. However, a recent book by Berrien (16) 
does provide a meaningful explanation of General Systems Theory (GST) that 
should have considerable heuristic value. Berrien makes some intriguing 
distinctions between two types of system inputs (maintenance versus signal), 
two types of system outputs (usable versus waste), and among three concepts 
of system growth, adaptation, and learning. Simply studying the adaptive 
mechanisms of the training .svibsy stem (with the heuristics of the GST 
model) should be an eye opener for most organizations. GST also leads to 
certain deductions about the relationship of subsystems (e.g. the training 
function) to the suprasystem (e.g. the organization). For example, a sub- 
system cannot survive if all its outputs must be directly usable by the 
suprasystem. The reviewer believes a careful reading of this book will yield 
a number of useful strategies for the training practitioner and suggest a 
large set of important hypotheses for the researcher. 

To sum up, a more sophisticated analysis of the learning task, a la 
Gagne; and a more sophisticated translation of work motivation theory, 
behavior modification principles, and system theory to the training and 
development enterprise would pay huge dividends in effective behavior 
change. So far, our efforts in these directions have been slight. 



O 

ERIC 



15 



New Developments in Technique 

Campbell et al. (42) document the fantastic amount of training and 
development activity that takes place in organizations. It is a pervasive 
enterprise. Almost all reasonably large corporations have formal, in-house 
training programs and many corporate training budgets are comparable to the 
budgets of many large universities. The Campbell et al. volume also dis- 
cusses 22 difjtinct training methods that are applicable to management 
development. The number would be even greater if other types of training 
were considered. Similar lists can be found in House (106), Blum and 
Naylor (20), and Lynton and Pareek (134). 

There are a number of surveys available [e.g. Foreman (72), Quakenboss 
(l6l), and Utgaard and Dawis (200)] that consider the frequency with which 
various techniques are used. On the job training, job rotation, lectures, 

and the conference or seminar method are used by almost everyone (i.e. 

75-90 percent) while techniques such as simulation, role playing, programmed 
instruction, and T-groups are used by a relatively small minority (i.e. 15- 
20 percent). One interesting survey was done by Hannon (93^ who asked a 

sample of 146 firms what they thought of their training and development 

programs. The almost unanimous response to this call for introspection was an 
expressed opinion that things were in bad shape. The reviewer agrees. 

The more recent trends in new techniques seem to be the following: 

Computer assisted instruction (CAT) . Computer assisted instruction is 
a sophisticated descendent of programmed instruction and the core elements 
are much the same. Duncan (63) and Stolurow (19 3) describe the distinctive 
features of CAI. A definitive source book is a series of readings edited by 
Atkinson and Wilson (5). The power of CAI lies in its memory and storage 
capability which allows many possibilities for interaction (automated) with 

the learner. 
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Among many possible interaction modes, the CAI system may permit drill 
and practice, i.e. the asking of questions by the student; a problem solving 
mode where algorithms may be called to help the student solve problems; or the 
Socratic mode, in which the computer asks the student questions, the student 
responds, and the system provides feedback for the response. A more familiar 
mode is simulation and gaming which tests the student against some model of 
the real world. 

A very sophisticated form of interaction is the tutorial mode. Besides 
being Socratic in its dialogue this mode has a managerial component in that 
different content subroutines and various instructional strategies can be 
used depending on the initial characteristics of the student and his pattern 
of responses during learning. Thus it attempts to stimulate much of the 
complexity of individualized tutorial instruction. 

Organization development . A relatively new approach toward training 
and development which supposedly takes into account a broader range of system 
considerations is organizational development (OD). At least the name is new. 
OD can take one of several colorations. One of the most attention getting 
is the management Grid which was recently expanded and codified by Blake and 
Mouton (17, 18). In its present form it consists of six phases, from the 
now familiar Grid seminar to a formal critique phase. Unfortunately, the 
enterprise rests on little data. A second type of OD approach is most 
commonly labeled "action research". A paper by Beer (12) gives a lucid 
description, along with a real world example, of what is meant by this term. 
The process is that the "change agent" must first search the organization for 
the most fertile ground in which to plant his initial development effort. 

Con commit ant ly he must collect data that will tell him if he is on the right 
track, guide future efforts, and demonstrate the worth of the 
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method to the rest of the organization. If the data are positive the change 
effort can be expanded and more data collected. The touchstone is not the 
content of the change effort but the ever expanding cycle of action — data, 
action — data. The process is also described by Zaner (213). A third major 
thrust is systems four management as described by Likert (124), It is a 
corporate wide attempt to instill participative and consultive management by 
means of conference techniques and the feedback of diagnostic questionnaire 
results. Finally, laboratory education has increasingly been modified 
include groups sampled from a vertical or diagonal slice of the organization 
[e.g. Benedict, Calder, Callahan, Hornstein, & Miles (14)]. Thus the inter- 
personal difficulties, communication problems, and interlevel conflict that 
hinder organizational functioning can be faced directly. 

Basic encounter and personal growth training . The reviewer senses an 
increasing emphasis in the T-group type literature toward even more exis- 
tential and less intellectual group experiences. For example, Buchanan and 
Schindler-Rainman (27) describe the so called personal growth experience. A 
parallel development is the use of direct encounter groups with management, 
as described by Golembiewski and Carrigan (84) and Golembiewski and Blumberg 
(83). 

Television . Video tape is seeing ever increasing use as a feedback 
mechanism. Kennedy (114) suggests how it can be used in training the "hard 
core" and Stbller (192) describes examples in sensitivity training and group 
counseling. 

Cross-cultural training . This label does not focus on a new technique 
but rather on an area in which new methods are needed. The training and 
development world seems to have discovered cultural differences only recently. 
Some of the most innovative work has been done for or by the military. For 
example, R. D. Campbell (43) summarizes the types of programs that have been 
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used to train people for overseas assignments and Foster (73) outlines a 
needs and task analysis for cross-cultural training. The non-military 
literature is more mundane. Lee (122) outlines five problems encountered 
when developing managers in developing countries but suggests no innovative 
solutions. Rodgers (17l) advocates an on-the-job training and counseling 
program for developing foreign managers and Harrison and Hopkins (96) 
describe a living-in program modeled after the NTL approach. The entire 
spectrum of cross-cultural studies of organization (not just training) has 
been reviewed by Roberts (169) and found wanting. 

The disadvantaged, the hard core, and the unemployable . Again, these 
developments do not deal with a new technique but with a new area in need of 
useful methods. As was mentioned at the start of this chapter, training and 
development is a fadish enterprise. Training the disadvantaged became fashio- 
able during 1967 and 1968 and there are now a large number of such programs. 

A survey by Hausknecht (99) of the Detroit membership of the American 
Society of Training Directors showed that two thirds of the member firms were 
involved with the hard core and 50% had a formal training program of some 
sort. The sources cited below are not exhaustive but are meant to illustrate 
the major distinctive parameters. 

One distinction is between programs run by a community or governmental 
agency and those conducted by the employing organization itself. Hutson (109) 
describes the total community involvement program in Ypsilanti, Michigan. 

This same program illustrates another distinction, namely, whether or not 
the trainee is assured of a permanent job if he completes the program success- 
fully. Many government programs financed under the Manpower Development and 
Training Act of course do not. 

A major distinction among such programs is in terms of training content. 

Many of them deal with remedial education [e.g. Murphy (146)]. Kline (11 7) 
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describes a computer based system for teaching basic skills. Ten packaged 
programs are available. Another major content area is specific job training. 
Jaffee and Friar (110) describe a job training program for secretaries that 
uses an In-basket simulation. Western Electric uses an entire plant as a 
vestibule site from which the trainees are assigned to other locations 
[Chemick & Smith (49)]. However, most job training is of the usual class- 
room variety [Doeringer (61)]. A third major content area deals with 
attitudes, motivation, and self concept considerations. It is here that most 
of the innovation has taken place. Ford T s Project 250 (Hellervi^ (101)] made 
extensive use of counselors and role models. The counselors monitored the 
trainees very closely and were available for assistance at any time of the 
day or night. Sensitivity training, role playing, and psychodrama have also 
been used [e.g. Purcell & Webster (16P), Hodgson & Brenner (105)]. 

A number of programs have tried to deal with the conflict between the 
disadvantaged employee and the already established work force. Morrison (145) 
gave a group of blacks and whites an attitude scale measuring racial attitudes 
The participants were required to respond to the questions aloud and the 
feelings which were generated became the inpbts for group sensitivity sessions 
VanBrunt (202) gives an account of using a T-group to overcome the resistance 
of supervisors to a remedial type training program. Rosen (173) used on-the- 
job role playing to increase the involvement of supervisors in the special 
problems of the disadvantaged. 

Obviously, specific programs can combine one or more of these content 
areas* A very comprehensive program which includes almost all of them is 
described by Adelberg (1). 

Overall, new developments in techniques during the period of the review 
have not; been startling. What has proven noteworthy, is the sudden discovery 
of discrimination and cultural /ethnic differences. 
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Evaluation Methodology 

The recurring admonition to "evaluate" training programs is a gross 
misrepresentation of the empirical question. It strongly implies a dicho- 
tomous outcome; to wit, either the program has value or it doesn’t. Such a 
question is simple-minded, unanswerable, and contributes nothing to practical 
or scientific understanding. The phrase should be banished. 

General discussion . Numerous papers [e.g. Ferguson (65)] suggest the 
use of Kirkpatrick’s model for training research. That is, training research 
should attempt to measure participant reactions , or how well they liked the 
program; learning , or the extent to which the training content was assimila- 
ted; behavior , or the changes in job behavior; and results , or the changes in 
organizational variables such as costs, productivity, and turnover. Cata- 
lanello and Kirkpatrick (45) surveyed 110 firms as to which of these variables 
they used in evaluating their training efforts. Not surprisingly, a high 
percentage assessed trainee reactions but few tried to measure behavior or 
results. They conclude that training research is still in its "infancy". 

The Campbell et al. (42) volume devotes one chapter to training x ^.search 
methodology. The criteria problem is discussed at length, experimental design 
problems are reviewed, feedback and systems problems are touched on, and the 
question of what constitutes interpretable data is faced but not solved. 
Elsewhere, Campbell (40) has argued that so called "objective" dependent 
variables are of little value for training research. What is needed are 
carefully developed observational and measurement techniques for scaling 
actual behavior changes. A variant of the method of scaled expectations 
[Smith & Kendall (187)] is suggested as a difficult but very useful strategy. 
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Dependent variables, A number of recent studies have investigated new 
approaches to training criteria* Eddy, Glad, and Wilkins (64) let participants 
develop their own criteria. One thing they found was that there are stylistic 
differences in individual approaches to training, such as: the traditional 

desire for knowledge, fear of failing, time filling, and socializing. Baum, 
Sorenson, and Place (10) measured the change in perceived influence of 
various individuals within the work group resulting from human relations 
training* An interesting finding was that although the managers self 
perceived influence stayed the same, his subordinates perceived him to have 
less* Bon jean and Vance (21) attempted to develop a measure of change in 
self actualization. However, the scales appeared to be nothing more than 
a means for rating the perceived importance of Herzberg type job factors. 

In a very interesting T-group study Dunphy (62) asked undergraduates, over 
the course of a semester, to write a weekly paper interpreting what was going 
on in the group. The papers were then content analyzed via a computer 
program with the aim of measuring role differentiation and describing group 
phases. 

In a pioneering study, Flaugher, Campbell, and Pike (68) obtained 
samples of white and black medical technicians who were rated on a number of 
job performance factors by both black and white supervisors. There was a 
slight tendency for white supervisors to rate whites higher than blacks and 
3. somewhat greater tendency for black supervisors to rate blacks higher than 
whites. It is imperative that we study this aspect of the criterion problem 
from every possible angle. 

Experimental design * Little is new in the area of pragmatic experi- 
mental design. Campbell and Stanley (39) remains the definitive treatment. 
Weiss and Rein (205) challenge the usefulness of the experimental and quasi- 
experimental approach in complex field research on the grounds that it is 
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difficult to select satisfactory criteria, the situation is essentially 
uncontrolled, treatments are not standardized, and most experimental designs 
are too limited in the information they can produce. As alternatives, they 
suggest process oriented qualitative research, historical research, and case 
analyses. In a rejoinder, Campbell (38) argues that none of the criticisms 
leveled by Weiss and Rein are intrinsic to the experimental method. 

On a more primitive level Golembiewski and Carrigan (84) and Becker 
(11) argue the relative merits of the pre and post measure, no control 
group design. The former did a study in which they measured the effects of 
an organizational development program using Likert. f s 42 item profile of 
organizational characteristics pre and post. Positive changes were observed 
and attributed to the OD effort because they were in line with the theory 
and supported by much anecdotal evidence. Becker argues that such a design 
may be permissible if the objective is to sell something to management but 
it is not science. 

The statisticians have been reasonably busy arguing about how best to 
judge the significance of the data yielded by a particular design. Lykken 
(133) employs a charming, if somewhat anal, example to put yet another nail 
into the coffin of statistical significance tests and high correlations that 
make little theoretical sense. However, D. T. Campbell (37) argues eloquently 
for a restricted but important use for null hypothesis testing. 

Fleiss (70) and Vaughan and Corballis (203) derive a number of strength 
of relationship measures from various design models and discuss their rela- 
tive vantages and disadvantages- The picture with regard to omega 
squared is not as simple as it may once have appeared, and these two articles 
bear careful reading by the research minded. Overall ( 15 . 4 ) continues pre- 
vious attempts to take a Bayesian approach to inferring the significance of 

experimental results. Lord (129) and Werts and Linn (207) discuss the prob- 
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lems concerned with making statistical comparisons between non randomized 
groups, a relatively common problem in training research. 

Finally, the time honored Hawthorne effect has come in for its share 
of lumps. Sommer (189J makes the general argument that it should not be 
considered as an experimental error but rather as a much too global label 
for important independent variables. He suggests we should study the 
phenomena intensively from a multi-dimensional point of view and argues that 
to control for the Hawthorne effect is to rule out much of psychology. For 
example, if pay effected performance in an unequivocal manner, industrial 
psychology would become mere economics. Taking aim at the Hawthorne studies 
proper, Sykes (195) builds a convincing case that economic rewards did indeed 
play a large part in explaining the Hawthorne data and Carey (44) argues that 
the morale or “attention” characterization of the Hawthorne effect was itself 
confounded with many others in the original studies. The reviewer agrees 
that the notion of the Hawthorne effect as a global nuisance variable should 
be cast aside and replaced with a more sopohisticated non-error oriented view. 

Sy s t ems cons id e rat ion s. Lundberg (13^) strikes a responsive cord when 
he argues that regardless of what happens in a management development program 
the organization may in fact permit no changes in behavior. Thus it would be 
foolish to expect to find them in a research study. Belas co and Trice (13) 
and Denova (58) discovered that certain elements in the training program 
serendipitous ly increased loyalty and commitment to the organization. In an 
excellent paper, Goodman (86) outlines the system in which a hard core training 
program must operate and analyzes possible conflicting objectives. For 
example, certain conflicts between community agencies and various organiza- 
tional subsystems are reasonably predictable. Lastly, Gieiner (88) presents 
an interesting descriptive account of the organizational situation in which 

the well known Blake, Mouton, Barnes, and Greiner (19) Management Grid study 
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was done. He argues that a number of previously unmentioned situational 
factors made it possible for the program to have the effects it apparently 
did, and his description adds a great deal to the interpretation of the 
results. 

A unique contribution. One of the most provocative methodological 
papers of recent years is the attack by Argyris (4) on the scientific method 
as it is used in the social sciences. It should be read and reread by every- 
one who wants to do empirical research in organizations. The main thrust 
of his argument is that much of the research in social and organizational 
psychology creates a Theory X relationship between the researcher and the 
subjects, with predictable consequences for subject behavior. Research 
subjects are simply not the passive creatures we believe them to be and the 
only way out of the dilemma is to involve them as full participants in the 
research effort. This rules out such things as deception research, many 
questionnaire studies, and many studies requiring control groups. 

In sum, the methodology of training and development research cries for 
innovation. Unfortunately, a flight into more sophisticated statistics, 
even such meritorious ones as variance estimates, does not face up to che 
principle issue. As yet we have no workable technology that is capable of 
producing a large amount of training research data. 

Empirical Research 

Ideally, this section should be organized around dependent variables. 
That is, the research literature should tell us what kinds of experiences will 
produce particular outcomes and what parameters affect these treatment /outcome 
relationships. Such is not the case. Research studies t^nd to cluster 
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around demonstrating effects for a particular training technique or focus on 
specific groups of personnel (e.g. management or the "hard core"). The sub- 
sections that follow represent the reviewer's qualitative cluster analysis of 
what is published. 

Management Development 

A base line. Much of the management development research during the 
last two decades has been summarized by Campbell et al. (42). They review 
84 studies and 73 of them are organized via a 3-way classification. One 
classification dimension is in terms of methods and content. Five categories 
are used: 1) a broad category labeled general managment and supervision 

programs which are taught via lectures and small group discussions and include 
material on labor relations, company policies, leadership, etc. J 2) general 
human relations programs, employing conference methods and role playing, that 
deal with the human relations problems of supervisors? 3) programs that 
attempt to teach generalized problem solving and decision making skills? 4) 
T-groups, sensitivity training, and laboratory education? and 5) specialized 
programs which are devoted to very specific objectives such as increasing 
reading speed or reducing the halo error in appraisal systems. 

In addition, the studies were classified according to whether internal 
or external criteria were used and whether the study employed "some" or "few" 
experimental controls c Internal criteria are outcome measures linked 
directly to the training content and assessed during or immediately after the 
learning experience. Attitude measures, achievement tests, in-basket per- 
formance, and opinion questionnaires are examples. External criteria are 
designed to assess behavior changes in the organizational role. By "some" 
control is meant the inclusion of a control or comparison group. "Few" 
controls are defined as no control group but both a pre and post measure for 
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the trained group. Given these three means of classification, the 73 studies 
group themselves as shown in Table 1. 



Insert Table 1 about here 



As can be seen from the table, the large majority of studies used 
internal criterion measures. In over 20 years of research only 21 studies 
used external criteria of behavior changes. Only 13 of these 21 were what 
could be loosely described as controlled studies and 9 of the 13 controlled 
studies produced statistically significant differences on a major criterion 
variable. Management development is not exactly a flourishing research area. 

Campbell et al. (42) generate a number of conclusions from these data. 

1. Approximately 80% of the 35 studies in the first two content 
categories produced significant results but over one-half of them used one 
particular kind of criterion measure, namely, an attitude measure of 
"employee centeredness" or "consideration". Surely this is an overly narrow 
research view of management development. 

In one of the best and most recent studies of general management 
programs, Schwartz, Stilwell, and Scanlan (178, 179) used a time lag design 
to examine the effects of a university sponsored program on management 
behavior. The participants were split into two groups which were trained 
six months apart, thus the second group provided a control for the first 
group to be trained. The Leader Behavior Description Questionnaire (LBDQ) was 
administered to the subordinates of each group before and after the program. 
Managers in the first group were described as becoming less active, less 
definitive, less production centered, less oriented toward supervisors, and 
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TABLE 1 



Classification of Management Development Research Studies by 
Content Area, Type of Criteria, and Degree of Experimental Control 



External Criteria Internal Criteria 

Controls Controls Controls Controls Total 



General 

Management Programs 

General Human 
Relations Programs 

Problem Solving & 
Decision Making 

T-groups & 
Laboratory Educ. 

Specialty 

Programs 



TOTAL 



13 



16 



10 



19 



26 



32 



20 



73 
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more oriented toward subordinates. In contrast, the second group was seen by 
their subordinates as becoming more active and using more structure. Apparen- 
tly there was an important interaction between the development program and 
other parts of the organization such that the second group reacted differ- 
ently than the first. This study deserves to be emulated. It used a 
feasible experimental design that provides considerable information. 

Unfortunately almost all. of the other studies of general management 
and human relations training cited by Campbell et al. provide considerably 
less information. 

2. Perhaps contrary to expectations, there has been more research on 
T-group training and laboratory education than any other specific area. 

T-group studies account for nearly half of those utilizing external criteria. 
There is evidence that T-groups produce behavior changes in the work role 
for about 20-25% of all participants. 

The backbone of the external evidence for the management development 
utility of laboratory education is found in the perceived change studies, of 
which there have been five (22, 30, 141, 199, 201). The primary dependent 
variable was an open ended question which asked subordinates and/or associates 
of the experimental and control subjects, approximately a year after the lab- 
oratory experience, to describe specific changes they had observed in the 
subject's behavior in working with people during the previous year. All 
studies featured at least one control group. Four of the five chose control 
subjects by asking the training participants to "nominate" people similar to 
themselves. Experimental and control subjects in turn nominated several 
associates as observers. 

The results obtained in the Bunker (30) study are typical. Responses 
to the open ended questions were content analyzed using 15 inductively 
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derived categories. Eleven of the fifteen subcategories yielded statistically 
significant differences between the experimental and control group with the 
trained group showing greater change. The greatest differences (20-25%) were 
in areas related to increased openness, receptivity and tolerance of differ- 
ences, increased skill in interpersonal relationships, and improved under- 
standing of self and others. There were no differences for initiation of 
action, assertiveness, and self confidence. 

While the results of these five studies seem favorable, they must be 
qualified in view of the way the control subjects and observers were selected. 
Also, with the exception of Underwood (199), the perceived changes were not 
evaluated in terms of their influence on job performance. 

The T-group studies using internal criteria which Campbell et al. (42) 
cite, have produced very mixed results. The evidence for laboratory produced 
changes in self awareness, interpersonal sensitivity, personality, and per- 
formance on case problems or business games is largely negative. Some 
positive results were cited for the ability of T-groups to change certain 
kinds of attitudes, but the data were not overwhelming. In essence, the 
positive data with external criteria and negative data with internal criteria, 
argues that we do not yet know what aspects of the training experience 
produce the behavior changes in the organization. 

3. Only a very few studies have been made of attempts to teach problem 
solving and decision making skills and the results have been largely negative. 

4. Studies comparing the relative effectiveness of two or more 
methods for the same goal or evaluating treatment interactions wii;h individual 
differences are too few to warrant making and generalizations. Actually, 
most of the empirical research deals with just a very few of the many possible 
methods. 
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5. In terms of methodological characteristics there is an almost 
exclusive reliance on statistical significance as a sign of changes to be 
interpreted. Almost no studies tried to link internal criterion changes with 
external criterion changes. Finally, no studies attempted to deal specifi- 
cally with the effect of organizational structure or climate on training 
activities. 

Given the above characteristics of management development research, 
the following sections summarize some of the more recent literature. 

Laboratory methods . Only two recent studies using an external criterion 
were found. O’Rourke and Castelli (153) conducted relatively instructured 
interviews with the bosses of 27 supervisors six months after they had been in 
a T-group. The results seemed to indicate favorable changes in job perfor- 
mance but the study featured no control group, no before measure, and the 
bosses knew the reason for the interview. Zand, Steele, and Zalkind (212) 
measured self perceived changes of manager’s job behavior via a 42 item 
questionnaire. Pre and post measures were employed but no control group. 

In terms of laboratory education objectives the post measures went down, but 
returned to the pre training state when the sample was followed up a year 
later. 

In one of the better internal criterion studies, Rubin (175) assessed 
changes in racial prejudice during a two week T-group with a 15 item ques- 
tionnaire that asked people to rank action alternatives in hypothetical 
situations. One of two training groups was given a pre-pre measure two weeks 
before the T-group started. Thus the difference between the first and second 
pre measures constituted the control comparison. The T-group did produce 
a decrease in racial prejudice and the effect was greater for those low on 
psychological anomy (measured by a 9 item Guttman scale). There was also 
a suggestion that the decrease in prejudice resulted from feelings of greater 
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self acceptance. In another good study, Hall and Williams (90) used 20 groups 
from each of three populations (student, management, and neuropsychiatric 
patients) to study the effects of laboratory experience on a group decision 
task — the prediction of juror capitulation in the film Twelve Angry Men. 

Half the groups were experimentals and half the groups were controls and 
differences were examined on decision accuracy, degree to which the group used 
its individual resources, and the degree to which the group produced better 
predictions than any of its individuals. The laboratory appeared to facili- 
tate this kind of decision making, but for some dependent variables, the 
effect was much greater for ad hoc groups than fox: established groups. 

In four rather poor studies, Slocum (185) demonstrated that college 
students reported on a pre versus post comparison that they were more sensi- 
tive and self aware after a T-group; Fins ton (66) used in interview to show 
that good, bad, and so-so reactions to a T-group were distributed about 
equally in an R & D sample; Golembiewski and Blumberg (82) showed rather weak 
attitudinal support for the positive effects of a management confrontation 
experience; and finally, Nadler and Fink (148) demonstrated changes, without 
a control group, on questionnaire measures of broad democratic attitudes. 

Laboratory education is a complex process. Fortunately, an increasing 
number of studies are beginning to explore this complexity. Varying the 
feedback parameter, Myers, Myers, Goldberg, and Welch (147) asked participants 
at the end of each session in an eight session T-group to rate each other 
sociometrically and to predict how others would rate them. They also were 
given feedback as to how they were rated. The dependent variable was the acc- 
uracy of their predictions. One control group made the ratings but was given 
no feedback and another control group did nothing. The crucial determiner of 
accuracy was not feedback but whether the participants rated other people. 

A study by French, Sherwood, and Bradford (75) tended to show the same 
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thing, in that "attending” to the variables to be rated produced almost as 
much change as feedback. When the cue properties of the variables were 
removed there was a significant drop in rated change. 

Culbert (56) varied the amount of trainer self disclosure (i.e. high 
versus low) arid noted its effect on the amount of individual "self awareness" 
exhibited in tape recordings of group sessions. There was an interaction 
between trainer disclosure and the stage of training. To maximize self 
awareness, as rated by judges, the trainer should practice high self disclosure 
at first and change to low self disclosure later in the training. Cooper 
(54) studied the effects of trainer attractiveness and the degree to which he 
exhibited behavior congruent with T-group values. Participants who rated the 
trainer as attractive and congruent became more like him in both attitudes 
and behavior (as judged from tapes). 

Two studies explored the interaction of the T-group itself with other 
supporting experiences. Bunker and Knowles (31) reanalyzed the original 
Bunker (30) data and compared the results of a two week versus three week 
laboratory program where the only difference was in the time devoted to 
lectures, exercises, and theory sessions. Time in the T-group remained 
constant. Results on the perceived change measure gave a significant 
advantage to the three week program. Friedlander (76) used six question- 
naire measures of work group functioning to study the effects of a laboratory 
program. The content of the laboratory sessions varied considerably but 
these differences were completely over shadowed by the amount of pre training 
and post training followup by the consultants. Friedlander also makes some 
biting comments about the reinforcement contingencies governing consultant 
behavior and argues that they tend to encourage discrete, short term training 
experiences. 
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Perhaps in reaction to a common criticism, Lubin and Zuckerman (130) 
used checklist measures of anxiety, depression, and hostility to show that the 
level of emotional arousal in a T-group is not as great as in a perceptual 
isolation experiment. 

The relationship of individual differences to T-group training continues 
to be a neglected area. Steele (19Q) found no relationship between trainer 
rating of participant change and the Myers-Briggs Type Indicator . Harrison 
and Lubin (9?) demonstrated that task oriented people were rated as learning 
more in a T-group than people oriented participants. However, we still do not 
know which are the more effective group members in the end. In fact, we still 
know absolutely nothing about how various kinds of people interact with the 
T-group experience. 

Other recent reviews of the T-group literature can be found in Buchanan 
(26), Delbecq (57) and Mangham and Cooper (136). All of them interpret the 
data in very favorable, optimistic, and even glowing terms. They see things 
differently than the present reviewer [e.g. Campbell and Dunnette (41)]. 

Research on management development exclusive of T-groups and laboratory 
education is abysmally infrequent. Witness the pitifully small number of 
studies cited below and the meager information they provide. The classifi- 
cation is that used by Campbell et al. (42). 

General management programs . Miller ( 142 ) used a conference and case 
method approach to train 54 supervisors in a variety of supervisory topics. 

As cited previously, a multi-stage need analysis was used to group partici- 
pants in terms of their training needs. Positive results were shown on 
specially constructed achievement tests. Kohn and Parker (118) report an 
opinion evaluation by 2000 managers who participated in a three day seminar 
sponsored by the American Management Association. Regression analysis was 
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used to determine the weight of various seminar components in determining 
overall satisfaction with the program. The opinion components with the 
largest beta weights dealt with: practicality of subject matter, the 

balance of participant backgrounds, and the opportunity for participation , 
all of which is not very surprising. Finally, six months after a one week 
development program using lectures and discussion groups, Thorley (197) 
interviewed the bosses of 234 English managers and discovered a generally 
favorable response to their subordinates participation in the program. None 
of these three studies used any experimental controls and taken together 
they advance the state of knowledge hardly at all. 

Human relations programs . Bartlett (8) asked participants to role 
play parts antagonistic to their previously determined management style. This 
led to considerable discussion of the participant^ organizational situation 
and tapes of the discussion were fed back to top management;. There was a 
subsequent reduction in organizational variables such as costs and absenteeism* 
however, no controls were provided and the inferences are tenuous. Burke 
(33) administered scales designed to measure Machiavellianism and social 
attitudes before and after an undergraduate course in human relations. No 
changes were observed. 

Problem solving and decision making . There have been almost no recent 
attempts to study the development of problem solving and decision making 
skills even though a number of strategies exxst for developing these skills. 

The closest thing is a study by Moore (144) which compared the business 
game versus case method in teaching problem solving in production management. 
There was little difference between the two on an achievement examination. 
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Training the Disadvantaged 

As one might expect, there has been very little published research 
dealing with training the disadvantaged. As a fad, this kind of training is 
still in the n let me describe my program 11 stage and rewards apparently are 
given for having programs not for sponsoring research. The reviewer suspects, 
and hopes, that there are many research reports currently residing in corpo- 
rate and agency files that will soon see the light of day. 

Training in basic skills . Byars and Crane (35) describe a program 
which was limited to basic skills by default. The New York Public Service 
Careers Programs sponsored 240 hours of classroom instruction for disadvan- 
taged applicants, mostly female. Significant gains were produced such that 
most participants were close to passing the high school equivalency examina- 
tions, but the job training aspect of the program ran afoul of New York City 
budget problems. Burcin (32) and Mollenkopf (143) did similar studies and 
demonstrated significant increases on basic skills achievement tests resulting 
from remedial training. Patten and Clark (155) did a six month follow up of 
48 minority group members who completed a literacy training program in 
Detroit. The program had made no provision for employment and only 12 of the 
48 had iobs. The overwhelming impression from the interview data was the 
extreme lack of confidence generated by a feeling of being hopelessly under- 
educated. The study reinforces Rosen, Williams, and Foltman’s (174) earlier 
study (and the conventional wisdom) that if a program doesn’t lead directly 
to a job opportunity, morale suffers severely and attitudes toward such 
training programs become much more negative. 

Job skills training . Two studies by economists attempted to judge the 
effects of job training programs financed under the Manpower Development and 
Training Act. Stromsdorfer (194) did a two year follow up of 1379 
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workers trained under the MDTA in West Virginia. He concluded that earnings 
and the amount of time employed increased significantly for the trained group. 
Comparing training costs to taxes paid suggested that the training paid for 
itself in 13 months. Main (135) surveyed a national sample of 1200 former 
MDTA trainees and matched them with 1024 untrained controls. After allowing 
for certain biasing factors, he estimated that the training increased earnings 
an average of $10 per week. In similar studies, Solie (188) and Scott (182) 
also demonstrated favorable results for retraining programs. In spite of their 
faults, retraining efforts seem to have had beneficial effects. 

A massive effort that should be studied intensively is Project 100,000 
being conducted by the Armed Services [Wool & Flyer (211)]. Since 1966, the 
goal has been to induct an additional 100,000 men per year, primarily by 
lowering standards on the Armed Forces Qualification Test ; and as might be 
expected, people from disadvantaged backgrounds are over represented. The 
new entrants are not identified in any way and proceed through normal basic 
training and advanced training activities. Preliminary results suggest that 
overall attrition rates and disiplinary problems are much the same as for 
individuals inducted under the old standards , but performance in advanced 
skills training is significantly lower. The project represents a golden 
opportunity to study new training strategies for disadvantaged people on 
whom we have lots of data. The reviewer hopes it is not lost. 

Easily the best and most informative research that occurred during the 
period of this review is reported by Hodgson and Brenner (105). Two studies 
in the Lockheed Aircraft Company, one in California, and one in Georgia, are 
summarized. The bulk of the training in both plants was job related but with 
some remedial training in reading and shop math. The Georgia program was 12 
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weeks long, was oriented toward fairly high level training in sheet metal 
work, included 72 hours of psychodrama and role playing, and the participants 
were paid only a subsistence stipend provided by a MDTA contract. The Calif- 
ornia program was only four weeks long, was geared toward specific training 
for specific jobs, and participants were paid a full wage for that job. 
Considerable individual counseling but no role playing or psychodrama was 
used. Three-fourths of the Georgia sample were black, two- thirds were 21 or 
younger, and all were male. The Calif ormia sample was older and evenly 
divided among blacks, Mexican- Americans , and whites. It included both males 
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and females. The unique thing about both samples is that the applicants had 
to meet four of the following five criteria: 1) school dropout, 2) unemployed 
head of household, 3) income less than $3000 during last 12 months, 4) poor 
work history, and 5) no primary work skills. At the California site 70% of 
the applicants were turned down because they weren’t "hard core" enough or 
because their arrest records were overwhelmingly severe. None of the trainees 
could meet traditional company hiring standards. Dropout rates for the 
training periods were extremely low. After four months on the job, turnover 
was about 10% in both samples, which was significantly below the normal level. 

A study of the California group showed no difference in quantity or quality 
of work between trainees and regular hires. The authors attribute the success 
of the training to appropriate instructional methods, frequent recognition 
and reinforcement, training content that was directly linked to a specific job, 
and jobs that were not "dead end". 

What have these few studies demonstrated? At least we know that basic 
skills can be improved and that job training programs can pay off if they 
are carefully done, include lots of personal attention, and lead to a 
desirable job. We know almost nothing about the effectiveness of efforts to 
deal with role problems arising from a lifetime of discrimination. 

Programmed and Computer Assisted Instruction 

Programmed instruction (PI) . The research literature on programmed 
instruction is large. What follows is meant to be a representative sample. 

Much of the literature is concerned with one time, one place comparisons 
between a PI method and a conventional method using internal criteria as 
dependent variables. For example, Hedberg, Steffen and Baxter (100) compared 
a progr amm ed text and a conventional text in teaching insurance fundamentals 
and demonstrated that the same content could be covered in less time with PI. 

Subjects also preferred the PI method* Neidt and Meredith (150.) also found 
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more favorable attitudes toward PI than conventional texts in an Air Force 
technical course and the difference was greater for the high ability students, 
Mayo (137) summarizes a number of studies on PI conducted in the Navy and 
concludes that PI yields similar learning in a shorter time than conventional 
methods, i.e., is more efficient. Comparable achievement in a shorter time 
seems to be a recurrent finding from PI research. However, there are at least 
two recent exceptions. Connor (52) compared a teaching machine, PI text, 
and conventional text for a course in electrical engineering and found that 
both the teaching machine and PI text produced higher examination scores than 
the control group. Cavanagh and Jones (46) compared a PI method to three 
conventional seminar methods for teaching management principles and found 
considerably higher scores for PI on a multiple choice criterion test. 

There are at least two possible explanations for inconsistencies 

in the above results. First, as shown by Pikas (157), the criterion used to 
measure achievement may not be "fair" to all methods. For example, Brinkman 
(25) compared PI to conventional methods for teaching certain aspects of 
geometry. However, the criterion test was geared directly to the content of 
the PI mode, which differed from the content of the conventional procedure. 
Mayo and Longo (138) compared a nine hour PI course to a thirteen hour con- 
ventional course for teaching electronics fundamentals and found no differ- 
ence on a test originally written for the conventional course but a signifi- 
cant difference on a .’r.est written for the PI course. Rawls, Perry, and 
Timmons (163) carefully constructed a criterion test that favored neither 
mode and found equal initial achievement but somewhat better retention and 
lower variability for the PI group. Long term retention is largely a 
neglected research topic. Second, most such comparative studies imply that 
PI is PI and a conventional method is a conventional method, yet the 

variability in quality must surely be great within each of these two modes. 
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Comparative studies are difficult because we have no quality model for 
instructional strategies. 

In the organizational setting, external criteria are sometimes used to 
assess the effects of PI. Patten and Stermer (156) used PI to train foremen 
in work standards but the results were equivocal. However, Cook (53) used 
PI booklets to train regional cosmetic saleswomen and the data suggest a 
significant increase in sales and lower turnover. 

A number of other PI studies have focused on certain parametric 
considerations. Individual differences, teaching machines versus programmed 
texts, the amount of material per frame, response mode (e.g. written versus 
oral), topic arrangement, pacing, and prompting versus confirmation or cueing 
versus knowledge of results (KR) , are the major ones. The latter distinction 
refers to providing numerous cues or stimulus support before the response 
is made such that the correct response is always given versus reducing the 
probability of a correct response and providing post response KR. 

Two studies examined prompting versus confirmation. Seidel and 
Hunter (183) found for a military technical specialty that stimulus support 
facilitates response acquisition during training but detracts from long term 
retention. Anderson, Faust, and Roderick (3) also showed that heavy 
prompting hinders post test performance. Variation in response mode (con- 
structive response versus "thinking it") had no significant effects. 

Berglund (15) varied the degree of partial reinforcement, or confirmation , 
but found no significant differences on the criterion test. Hartley (98) 
has reviewed the PI literature on self versus external pacing. The conven- 
tional PI wisdom says self pacing is best, but the data are not in complete 
agreement. A number of studies showed that external controls on the 
learner's pace had a facilitating effect. Noble (151) and Gaboon, Peterson, 

and Watson (36) investigated the interactions of various measures of individual 
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differences with achievement in PI and found no significant results, which is 
also a consistent finding in the literature. Johnson (112) generated a 
number of programs in which the topics were dispersed in varying degrees 
throughout the program. Although the more dispersed programs required more 
time, they led to better retention then when all the material on a topic was 
presented at a single location. Schuster (177) tested a scrambled branching 
program in which the learner must hunt for the reasons for a wrong answer. 

He found no achievement differences when the scrambled version was compared 
to a linear branching version, but subjects much preferred the linear method. 

Several studies investigated three parameters at once. Welsh, 
Antoinetti, and Thayer (206) varied response mode, confirmation — no confirm- 
ation and the amount of review material in a PI course designed to teacb 
insurance f undamentals . Attitudes and knowledge tests (varying in similarity 
to the program itself) were the principal criteria. The review material 
helped slightly, but response mode and confirmation made little difference. 
Also, PI was only superior to the conventional method on the criterion test 
most similar to the program. Whitlock (20 8) varied pacing, number of frames, 
and KR and found no difference across treatments on a knowledge test. He also 
makes the cogent point that the better the basic program, the less rex _nt 
are parametric differents. Attwood and Wiener (6) allowed subjects to select 
their own level of KR, cueing, and rate of stimulus presentation for PI 
training in a vigilance monitoring task. KR and stimulus presentation had 
beneficial effects. 

Additional reviews of PI studies are given by Schramm (176) and 
Burris (34). 

In sum, the recent PI literature holds no new surprises. A reasonable 
conclusion is still that, for appropriate material, PI is faster but 
probably does not lead to greater proficiency on an immediate post test. 
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Long term retention remains an open question. The failure of parametric 
changes to influence results suggests that the PI enterprise should get 
back to the basic question of the structure of what is to be learned. The 
payoff is in the substance, not the form, of the program. 

Computer assisted instruction (CAI) . It is apparently too soon in 
the cycle for a recognizable pattern of empirical studies on CAI to emerge. 

A great deal of hardware and software is being constructed but the research 
efforts are restricted largely to elementary and secondary education settings. 
Two studies are representative of the small amount of research in organi- 
zations. For teaching data processing principles, Schwartz and Haskell (180) 
compared a PI text to a CA T system that incorporated more branches and skip 
options. Achievement was the same, but the CAI system was slightly faster. 
Using a similar CAI system, Schwartz and Long (181) could find few differ- 
ences between CAI and a self study program for teaching new developments in 
computer technology. Dick and Lott a (59) compared CAI and PI in a student 
population and found PI to be slightly superior for teaching numerical 
concepts. The difference was due to the special difficulties that low ability 
students had with CAI. 

Taken together, these data do not favor the CAI strategy; however, 
all three studies used CAI systems that were quite unsophisticated and which 
used little of the potential capability of CAI. 

Additional Research Areas 

The remaining sections describe areas containing relatively little 
activity. 

Or ientation training. It seems obvious that an individual’s Initial 
period at work is extremely critical in terms of how he defines his activities, 
what he lear^ : expect from the organization, and how he learns his job. 

Gomersall and Myers (85) studied a one day orientation program for new pro- 
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duction employees in a large electronics firm. The training was designed to 
reduce their anxiety by explaining what the company expected, the hazing they 
would probably get from experienced employees, and the type of behavior to 
expect from their supervisor. As compared to a control group the trained 
group reached high production levels much more quickly. Lefkowitz (123) 
experimented with different schedules of vestibule and on-the-job training 
for sewing machine operators. An initial day in the vestibule followed 
by a day on the line followed by more vestibule training seemed to have the 
most beneficial effects. It is unfortunate that such a fertile area of 
research has not been tapped to a greater extent. 

Sales tr a ining . Another critical area that has not been researched 
to any great extent is sales training. The recent literature offers only 
two studies. Harris and Vincent (95) investigated the effects of £ two 
year life insurance training program on 88 salesmen who were matched with 
88 controls. Significant differences were found on first year premiums and 
size of policies produced. The investigators ruled out a self selection 
explanation for the results but could not rule out the possibility of 
regression effects. Graves (87) also studied life insurance sales training 
which included a three day clinic in role playing interviews. Large 
differences were found in total sales and the six month termination rate. 

Training via television . Although closed circuit television as a fad 
has run its course, a few studies still appear. Rawls and Rawls (164) 
compared CCTV to conventional instruction in educational psychology and 
discovered no differences in achievement or retention but very negativistic 
attitudes toward the TV mode. In addition, students spent almost no time 
looking at the screen. Rock, Duva, and Murray (17°) compared CCTV, films, 

i 

and conventional instruction in a military setting and demonstrated television 
to be at least as effective as the other modes. Questions of how to improve 
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the quality of TV instruction and overcome possible negative reactions have 
not been explored. One promising avenue is the use of video recording for 
providing feedback in certain kinds of skills chaining. Thoresen (196) 
used this mode to give history instructors feedback of how they encouraged 
class participation. Although the data are tentative, the additional feed- 
back seemed to have a positive effect. 

Team training . Training teams as coordinated units should be an active 
topic, given its potential importance in organizations. Some of the lab- 
oratory education and OD techniques do deal with team problems. This 
empirical research has already been discussed under management development. 
Blum and Naylor (20) point out that two fundamental questions in team training 
are the relative effectiveness of group versus individual training of team 
members, and the kind of feedback that is provided during training. 

The Ohio State group has studied two man teams working in a simulated 
radar situation where the objective is to track and intercept incoming 
aircraft. Johnston (11 3) varied the amount of coordination and communication 
in the training task and demonstrated that team training was better than 
individual training when the criterion task required coordination between 
individuals. Naylor and Briggs (149) investigated the effects of task 
complexity, task organization, and replacement of team memebers. They showed 
that transfer of team skills varies inversely with task complexity and that 
task organization was important only under the stress of changing team 
membership. S :rangely enough, the previous training experience of the replac- 
ement had only a very temporary effect on team performance. Briggs and 
Naylor (24) used three man teams and varied the degree of task organization 
and the fidelity of the training task (real radar scope versus a cardboard 
cutout). Team training did not transfer very well when the training simu- 
lation was of low fidelity. Briggs and Johnston (23) studied this effect with 
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regard to stimulus fidelity versus response fidelity and showed that stimulus 
fidelity was by far the most important. 

Klaus, Grant, and Glaser (116) used another laboratory task to examine 
the effects of different reinforcement patterns on team training. A clear 
finding was that team or group reinforcement must be supplemented by 
individual reinforcement both during training ^nd in the actual performance 
situation. Team reinforcement alone is not enough. 

The above studies suggest that team training has value for transfer 
to tasks requiring interaction but the additional increment is quite fragile 
and can be largely obviated by such things as lack of stimulus fidelity in 
the task or lack of individual reinforcement. However, the tasks used to 
study the benefits of team training have been quite limited and we have no 
good definitions of such concepts as team, coordination, or fidelity. 

Simulation . Again, the reviewer anticipated a large amount of material 
and again there was not very much. Two studies dealt with fidelity problems 
in simulated training equipment, rlaimnerton and Tickner (92) varied the 
fidelity of the remote operation of a toy trolley. Background detail and 
depth cues during training were crucial for initial performance but training 
fidelity had few effects on long term retention and performance. Essentially 
the same finding was demonstrated in a study by Grimsley (89) in which 
service personnel were trained on guided missile system controls of varying 
fidelity. Few differences in performance were observed when the criterion 
data were obtained four to six weeks after training. 

In management development there exist a large number of simulation 
methods such as business games, case problems, and role playing. However, 
these seldom find their way into research studies such that their unique 
effects can be studied [Campbell et al. (42)]. They are most often combined 
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with other techniques and the overall package is "evaluated". The business 
game is an infrequent exception. Raia (162) demonstrated that playing a 
business game improved test performance in a business policy course. Two 
levels of game complexity (fidelity?) did not influence the results. Steir 
metz and Patten (191) showed only that students reacted favorably to using a 
business game in an accounting course. 

Spec ialty programs . These studies are grouped here because they deserve 
mention but do not fit anywhere else. Chaney and Teel (47) report an 
excellent study of improving quality inspector performance by means of 
classroom instruction plus visual aids. A control group was compared to 
three experimental groups: classroom alone, visual aids alone, and classroom 

combined with visual aids. The training content was specified by a careful 
analysis of inspector performance and the criterion was the percent of 
defects subsequently discovered on the job. The largest increment in the 
criterion resulted from using visual aids. 

In one of the few cross cultural studies, Chemers (48) used the 
"culture assimilator" to train Americans in Iran. The technique asked the 
participant to analyze hypothetical situations in a specific culture and then 
provided feedback for right or wrong analyses. When asked to lead three man 
Iranian problem solving groups, the trained Americans were found to generate 
more favorable group climates and better leader-member relations. However, 
group productivity did not change. 

Finally, Viteles (204) reports a long range follow up of executives 
who participated in the university of Pennsylvania’s humanistic studies 
program. The trends toward more liberal attitudes and less emphasis on 
economic values which were found in the original study tended to hold up 
over the period of the follow up. 
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Summar y of Empirical ?£esults 

What do we know? We know that management development can change 
managers toward more employee centered attitudes. We know that laboratory 
education probably can change behavior in the work role, but the nature and 
implications of these changes are unclear. We know that PI is at least as 
effective as conventional instructional methods in some situations and is 
probably faster when used appropriately; however many parametric and 
ituational contingencies remain unspecif ied. We know almost nothing about 
what makes orientation, sales, or team training effective. Hard core 
training programs can produce valuable outcomes but we really don’t know 
why. We know that technical training, as well as remedial training in 
basic skills does produce significant increments in knowledge. We do not 
know anything about the relative effectiveness of different training strategies 
for achieving particular objectives. In sum, we know a few things but not 
very much. 

Concluding Remarks 

Even though the study of training and development problems has produced 
a certain amount of knowledge and there are grounds for a bit of optimism, 
one cannot come away from this literature without feeling disheartened. The 
yield of information is depressingly small, and if current trends are extrap- 
olated, there are few reasons for expecting any significant increase in the 
rate of return. We simply must get off the trend lines we are currently 
following. Potentially, the training and development enterprise is an awesome 
instrument for change. However, there a: ^ both internal and external reasons 
for why it has not realized its potential. 
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The major internal reason is that there has been a broad and full 
scale retreat from the fundamental task of def L-^ng what is t c be learned. 

If this review illustrates nothing else, it indicates that in area after 
area researchers and practioners have retreated from a concern with the 
structure of what is bo be learned to an almost exclusive concern with hard- 
ware and techniques. This is as true for computer assisted instruction as it 
Is for laboratory education. 

The major external reason is that rewards are given for putting 
together programs, courses, or automated systems that are attractive, and that 
elicit a favorable impression from trainers, trainees, and sponsors. There 
are few incentives available in public or private institutions for attracting 
the personnel and stimulating the kind of effort it will take to develop 
sound theoretical models, build a technology of assessing what is to be 
learned, and accumulate a broad data base. As a nation, we seem unwilling 
to devote many resources to these kinds of things even though many of our 
most crucial national problems stem from an inability to educate, train, and 
develop. 

These phenomena are nowhere more apparent than in our approach to the 
so called hard core. Not too long ago organizations were finally coerced 
into discovering that unequal opportunity created problems. The training 
response has been to proliferate relatively short term "programs 11 . At best 
this response has had a very limited success. At worst, it is mere tokenism. 
The training establishment has failed to describe hard core training needs in 
specific behavioral detail and to directly link training content to desired 
behaviors. But then why should it? It is not reinforced for doing so. Our 
collective tragedy is that this potentially lethal problem will become larger 
and larger and no long term solution will result. We must become more 
political as well as more empirical and theory oriented. 
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In spite of these heavy constraints, the few bright spots in this review 
suggest that some progress can be made. If we are ever to make training and 
development a profitable enterprise in terms of important behavior changes we 
must at least do the following: 

1. Devote considerable time to an empirical analysis, via the systems 
approach, of the training and development system and its interactions with 
other systems. This must go considerably beyond putting general labels on 
block diagrams. 

2. Take an intelligent plunge into the methods and concepts of 
behavior modification. It holds considerable promise. 

3. Adopt the PI model for every training activity. That is, our task 
should be to specify terminal behaviors, decompose the learning task into 

its structural components, and seek an optimal sequencing of these components. 
This is rational not mechanistic behavior. 

4. Forget about the either/or approach to training evaluation. Instead, 
we should worry about measuring behavioral outcomes and their interaction 
with other subsystems in the organization. We should also worry about the 
differential effects of competing training strategies. Knowing these 
differential effects is the ultimate payoff. 

In moments of guarded optimism, the reviewer believes that moving in 
these directions would provide substantially greater knowledge and far more 
beneficial practices than have characterized the field during the last 20 
years. 




FOOTNOTE 



The writer is indebted to Janis S. Holtzman for invaluable 

assistance in searching the literature and to Carol M. Hawks 
for skillful preparation of the manuscript. 
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